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V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



D2: Paik David S.: 'Autonnated flight path planning for virtual endoscopy* Medical 
Physics, vol. 25, no. 5, May 1998, pages 629-637, XP002083445 USA 

1.1 The subject-matter of claims 1 and 55 is novel as none of the available prior art 
discloses a path planning method for a dataset with a cavity and a boundary, 
where the path is automatically determined between start and end points which is 
responsive to a penalty associated with passing through various points in the 
cavity. 

1.2 Document D2, which is taken as being the closest prior art, shows a method of 
path planning, comprising, providing a (medical imaging) dataset representing a 
cavity and a boundary; providing a plurality of points in said dataset, including at 
least a starting point and an ending point (see page 631, "Initial Path Selection" - 
page 632). 

The subject-matter of claims 1 and 55 differs from this known method in that the 
path is automatically determined between start and end points responsively to a 
penalty associated with passing through various points in the cavity. 

The problem to be solved by this invention is to automatically plan a path which is 
not adversely affected by small errors in the data acquisition by planning a path 
that does not alway lie substantially on the centre-line of the cavity. 

The solution given in claims 1 and 55 is considered to be inventive as it is not 
known or hinted at in the available prior art to use a penalty function associated 
with various cavity points to plan the path. Similarly, the subject-matter of claim 48 
is considered to be novel and inventive as it is not known or hinted at in the prior 
art to provide a method that avoids the medial axis and does not approach the 
boundary in at least two bends. 

2 The subject-matter of claim 53 is considered to be novel and inventive as it is not 
known from the prior art to erode, determine distance and then open dataset as 
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described in this claim in order to skeletonize a dataset. 



3 Claims 2-47 and 64-70 are dependent on claim 1 and therefore also fulfil the 

requirements of the PCT with regard to novelty and inventive step. Claims 49-52 
are dependent on claim 48, claim 54 is dependent on claim 53 and claims 56-63 
are dependent on claim 55 and therefore also fulfil the requirements of the PCT 
as regards novelty and inventive step. 
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In. accordance ^v^^a preferred embodiment of the invention, the view is rendered using 
a raycastiag method, for example as described in U.S, provisional application serial number 
60/075,519 titled "Raycastiiig System and Method", filed on February 23, 1998, by applicants 
S, Akerman and G. l^ller, the disclosure of which is incoiporated herein by reference. 
5 Preferably, the distance from the boundary which is determined for each point along the path, 
is used as a lower limit for the ray casting algorithm, since there can be no exterior voxels 
closer than the determined distance. 

Althongii the above methods are generally described as including the planning of all the 
aspects of the path, in a preferred embodiment of the invention, the above described methods 
10 are used for only some of the aspects. Alternatively or additionally, tlie order of steps may be 
— efiangM^^S/Si^steps-sp^^^^ 



invention, lazy evaluation techniques are utilized, to delay hea\y computations and/or reduce 
memory requirements as much as possible. Such computations inclodej evaluating a penalty 
function and/or constructing a graph, 

15 In a preferred embodim ent of the invention, a user performs real-tim e control of various 

slewing parameters while vicwmg a path generated in accordance with a prefeixed embodiment 
of tiie invention. Such parameters may include illumination parameters, sucli as position, 
movement and decay as a function of distance, speed, direction of ga^ie, angle of . gaze, field of 
yi&w size and aspect ratio. 

20 In accordance with some preferred embodiments of the inventiotL some of the methods 

described herein are applied in an iterative manner. In one preferred embodiment of the 
inventiori, a user enters limitations, the system generates a path which attempts to meet these 
limitations and then the user possibly changes these limitation, based on the quality of the 
generated path an.d/or the generated \new. PreferablVj at least some of the computations, such 

25 as distance computations, are performed only once and not repeated each iteration. 
Additionally^ preferably not ail the limitations need to be entered each iteration. One example 
of user entered limitations is a set of points through which it is desired that the path pass. 

Additionally or alternatively, the above described methods may be applied as a post 
processing step to a path generated by other means and/or entered by a user, especially for 

30 smoothing such a path and/or for calculation of viewing parameters. In one -preferred 
embodiment of the invention, only optimal viewing angles and velocities are determined for a 
fixed path In a preferred embodiment of the invention, the methods are used to select a path 
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CLAIMS 

1 . A method of path planning, coirprising: 
5 providing a medical imaging dataset representing a cavity and a boundary; 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

aatomatically determining a path betv/een the starting point and the ending point, 
responsive to a penalty associated with passmg through various points in the cavity. 

10 

2r A":method-ac.Mrding:^ 

morphology of the cavity. 

3. A method according to claim 2, wherein said morphology comprises a width. 

15 

4. A method according to claim 2 or claim 3, wherein said morphology is a local 
jnorphology- 

5. A method according to any of claims 1-4, wherein said penalty function is responsive 
to the path, 

6. A method according to claim 5, wherein said penalty function is responsive to an 
amount of local bending of the path. 

7. A method according to any of claims 1 -6, wherein antomatically detemiining a path 
comprises automatically determi ning a trajectoiy of an origin of a viewport. 

8. A method according to any of claims 1 -7, wherein providing a pl-urahty of points 
comprises providing a trajectory, 

9. A method according to any of claims 1 -8, wherein automatically detenruning a path 
comprises automatically determrning a trajectory of an aiming point. 
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10. A method accordi^^ any of claims 1-9, wherein automatifl^ detemiining a path 
comprises automatically deteriBiniiig an angular orientation of aline of sight, relative to a path 
traveled by a viewport origin. 

5 11, A method according to any of claims 1-9, wherein automatically detennimng apath 
comprises automatically^ determining an angular orientation of a line of sight relative to apath 
traveled by a viewport origin, responsive to a local width of tlie cavity. 

12. A method according to any of claims 1-9 or 1 1, wherein automatically determining a 
1 0 path comprises automatically determining an angular orientation of a line of sight, relative to a 



"^ pah-traveIea"by-a-vie w pot^~Qiig^ 



13. A method according to any of claims 1-1 0, wherein automatically determining a path 
comprises automatically detemsining at least one viewing parameter along a trajectory of a 

15 view origin point. 

1 4. A method according to any of claims 1 - 1 3, wh erein said pemdty depends on a viewing 
quality possible irom a point. 



20 



25 



30 



1 5 . A method according to claim 1 4, wherein said viewing quality depends on human 
perceptual abilities. 

16. A method according to claim 14 or claim 15, wherein said viewing quality depends on 
a specific task to be performed with said path, 

17. A method according to any claims 1-16, compriskig smootliing the path. 

18. A method according to claim 17, wherein said smoothing is dependent on a local width 
of the cavity, at the smoothed portion of the path. 

1 9. A method according to any of claims 1 -1 8, comprising autoroalLcally repeating at least 
said automatically determining a path between said starting and ending pomts. 
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20. A mcliiod accordin^^any of claims 1-19, comprising prov^^ at least one user- 
provided liraitaiion on said path determination. 

21 . A method according to claim 1 9, wherein automatically repeating comprises 

5 automatically rep eating automatically determining a path, responsive to at least one user- 
provided limitation. 

22. A method according to claim 20 or claim 2 1 , whereiD said at least one limitation 
comprises a rigid limitation. 

10 

^^237"" — :fcmethodiacc.ording:to.-:any-ofcldmJL:30-^^ — 



r 



comprises a flexible limitation. 

24. A method according to any of claims 20-23 , comprising iiidj.cating to a user which 
15 Hmitatioiis are not met. 

25. A method according to any of claims 1-24, comprising selecting a data granularity 
level for said path determiaation. 

20 26. A method according to any of claims 1-25, wherein automatically detcrminmg a path 
comprises evaluating a penalty fuaclion fox the points. 

11. A method according to claim 26, wherein said penalty function is dependent on the 
distance of the point from abotmdary of the cavity. 



25 

28. A method according to claim 27, wherein said penalty function is lower for points 
which are further from 1he boundary, 

29. A method according to claim 28, wherein said penalty function has a substantial rate of 
30 increase when approaching said homidar>', 

30. A method according to claim 28 or claim 29, wherein said penalty function has a low 
rate of change away from said boundary. 
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31. A niethodacccnrding to any of claims 27-30, comprising determiiiingsai^ 
earosion. of the dataset. 

5 32. A method according to auy of claims 27-30, comprising detcrmming said distance by 
wave propi^ation from the boundaries of said cavity. 

33. A method according to any of claims 1 -32, -wherein said determining a path comprises 
determining a relatively short path. 

10 

3 4T XmetH M-accord iBg-tQ-claim-3 - 37:wheT;einTa:relatively^^ 

path which takes into consideralion the penalty value associated with tiie various locations. 

( 

35. A method according to claim 33 ox claim 34, wherein automatically detennitiing a patli 
1 5 comprises generating a graph representing at least a portion of the cavity. 

36. A method accoiximg to claim 35, wherein said path is determined by applying a path 
finding method to the graph and wherein said portions of said graph are generated only when 
needed by said method. 

20 

37. A method according to claim 35 or claim 36, wherein aatomatically determining a path 
comprises determining a path using Dijkslra's shortest path finding method on said graph- 

( 38. A method according to any of claims 35- 37, wherein said graph includes only a subset 

25 of voxels in said cavity. 

39. A method according to claim 38, wherein said graph comprises substantially only a 
skeleton of said cavity, 

30 40. A method according to claim 39, wherein said skeleton is found utilizing data firom 
erosion of the cavity, which erosion is utilized to determine a distance of interior points from 
said boundary. 
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41 . A method accordingto any of claims 1-40, wherein said dataset is represented by 
voxels. 

42. A method according to any of claims 1-41, wherein said boundary is represented by 
5 polygons. 

43. A method according to any of claims 1-42, wherein said dataset comprises a CT 
dataset. 



10 



44. A method accorduig to any of claims 1 -42, wherein said dataset comprises an MRI 

45, A method according to any of claims 1-42, wherein said dataset comprises a MM 
dataset. 



15 



46. A method according to any of claim 1 -45, wherem said boundary has small holes 
therein and wherein said path does not pass throxigh holes narrower than a predetermined 
width. 

20 47. A method according to claim 46, wherein said predetermined width is dependent on a 
morphology of the cavity. 

48. A method of path planning, comprising: 

providing a medical dataset representing a cavity having a plurahty of bends and a 

25 boundary; 

providing a plurality of points in. said dataset, including at least a starling point and an 
endiTig point; 

automatically determining a path between the starting point and the ending point- 
wherein said path does not remain substantially in a medial axis of the cavity and does not 
30 approach closer than a predetennined distance to said boundary, in at least two of said bends. 

49. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does not approach closer tiian one voxel to said boundary. 
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50, A metihod according to claim 48, wherein said dataset is represented using voxels aod 
wherein said path does not approach closer than three voxels to said boundary. 

5 51. A method according to claim 48, wherein said -dataset is represented using voxels and 
whereia said path does not approach clos^ than one tenth the local width of said cavity, to said 
boundary. 

52. A method accordiag to claim 48, wherein said dataset is represented using voxels and 
10 wherein said path does pass through holes in said boundary which are narrower than a 

~^ predef^mhied'wTdtE ' ' ' 

53. A method of simultaneously distance determining and skeletonizing a dataset including 
a cavity and a boundary thereof, comprising: 

15 eroding said cavity, using a series balls of increasing radius Rj; 

determining a distance of points interi.or to the cavity, from the boundary, utilizixig said 
erosion; 

opening said eroded cavity^ for each radius R^^ using a ball of radius 1; and 
accumulating the points which are removed from said eroded cavity by said opening, to 
20 fonn a skeleton, 

54. A method according to claim 53, wherein erosion by a ball R comprises eroding the 
result of eroding with a ball of radius R-1 , with, a ball of radius 1. 

25 55 . A method of path planning^, comprising: 

providing a dataset representing a cavity and a boundary; . 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
30 responsive to a penalty associated with passing through various points in the cavity. 

56. A method according to claim 55, wherein said penalty function is responsive to a width 
of the ca^dty. 
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57. A method according to claim 55 or claim 56, wherein said penalty fianction is 
responsive to an amount of local bending of the path. 

5 58. A method according to any of claims 55-57, wherein auloniatically deteimiring a path 
comprises evaluating a penalty function for the points. 

59. A method accortling to claim 58, wherein said penalty function is dependent on the 
distance of the point from a boundary of the cavity. 

- 10 

60^ ^^nmetfiM^coTding"^^ 

which are further from the boundary. 

61 . A method according to any of claims 55-60, wherein said detcmiiimig a path comprises 
15 deterniining a relatively shon path- 

62. A method according to claim 61, wherein a relatively short path comprises a shortest 
path which takes into consideration the penalty value associated, with the various points, 

20 63. A method according to claim 61 or claim 62, wherein automaticaJly detennining a path 
comprises generating a graph representing at least a portion of the cavity and wherein said path 
is determined by applying a path finding method to the graph and wherein said portioiis of said 
graph are generated only when needed by said method. 

(. 

25 64. A method according to any of claims 1 -47 or 55 -63 , wherein said penalty function is 
responsive to an Euclidean distance of said various points from said boundary. 

65. A method according to any of claims 1-47 or 55-64, wherein said pat]i planning allows 
a path to pass through two diagonally-adjacent voxels. 

30 

66. A method according to claim 25, wherein said granularity is determined responsive to a 
morpholog>^ of said cavity. 
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67. A method according to claim 66, wherein a local granularityTs determined and wherein, 
said morphology comprises a local morphology. . 

68. A method according to claim 67, wherein said local morphology comprises a local 
5 width. 

69. A method according to claim 25, wherein a local granulariiy is determined and wherein 
said granularity is determined responsive to a distance of a locality from a cavity boundary. 

10 70. A method according to claim 25, wherein a first granularity is determined for a first 
— path~plamiing-andr€om 



using said first path as a starting point for said repeated path planning. 



c 



37 



mNDBD SHEET 



INTERNA 



AL SEARCH REPORT 



Inii^^fbnal Application No 

PCT/IL 98/00087 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 6 G09B23/28 A61B1/00 



According to International Patent ClassUicatk>n(IPC) or to t>oth national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (ctasstticatron system toUowed by classification symbols) 

IPC 6 G09B A61B G06T 



Documentation searched other than minimum documentation to the extent that such documents are Included in the fields searched 



Electronic data t>ase consulted during the international search (name of data base and. where practical, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category " 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



wo 98 11524 A (THE RESEARCH FOUNDATION OF 
STATE UNIVERSITY OF NEW YORK) 
19 March 1998 



1-5, 

7-13,17, 
19-22 , 
26-30 , 
33-41, 
43-45, 
48,49, 
55,56, 
58-63 



see abstract 

see page 6, line 6 - page 11, line 11 
see page 13, 1 ine 1-7 
see page 14, line 13 - page 16, line 30; 
figures 1-6 

-/- 



1 y j Further documents are listed in the continuation of box C. 


j Patent family members are listed in annex. 


- Special categories of cited documents : ^^^^^ document published after the International filing date 

or priority date and not in conflict with the application but 
"A" document defining the general state of the art which is not ^.j^g^j understand the principle or theory underlying the 
considered to be of particular relevance invention 


"E" eartier document but published on or after the international document of particular relevance: the claimed invention 
filing date cannot be considered novel or cannot be considered to 

T" document which may throw doubts on priority claim(s) or involve an inventive step when the document is taken alone 
which is cited to establish the publicationdate of another -y- document of particular relevance; the claimed invention 
citation or other special reason (as specified) cannot be considered to involve an inventive step when the 

"O" document referring to an oral disclosure, use. exhibition or document is combined with one or more other such docu- 
ottwr means ments, such combination being obvious to a person skilled 

"p" document published prior to the international filing date but ' 
later than the priority date claimed document member of the same patent famtty 


Date of the actual completion of the international search 


Date of mailing of the international search report 


9 November 1998 


27/11/1998 


Name and mailing address of the ISA 


Authorized officer 


European Patent Office, P.B. 5818 Patentlaan 2 
NL - 2280 HV Rijswijk 
Tel. <+31-70) 340-2040, Tx. 31 651 epo nl. 
Fax: <+3l-70) 340-3016 


Beitner, M 



Foon PCT/ISA/210 (second shwi) (July 1992) 



page 1 of 2 



interna^Vnal search report 




In ^Vuonal Application No 

PCT/IL 98/00087 



C.(Continuation) OCXJUMENTS CONSIDERED TO BE RELEVANT 



Category ' Citation ot document, with indication. where appropriate, of the relevant passages 



Relevant to claim No. 



PAIK DAVID S.: "Automated flight path 
planning for virtual endoscopy" 
MEDICAL PHYSICS, 

vol. 25, no. 5, May 1998, pages 629-637, 

XP002083445 

USA 

see abstract 

see paragraphs: "I. INTRODUCTION"; "II. 
DEFINITIONS"; "III. BACKGROUND"; "IV. PATH 
PLANNING ALGORITHM"; figures 1-7 

RUBIN G.D.; BEAULIEUC.F. ET AL.: 
"Perspective volume rendering of CT and MR 
images: applications for endoscopic 
imaging" 

RADIOLOGY, RADIOL. SOC . NORTH AMERICA, 
vol. 199, no. 2, May 1996, pages 321-330, 
XP002083446 
usa 

see abstract 

see paragraph: "MATERIALS AND METHODS" 
see figures 1-3 

WO 97 09690 A (NORTHROP GRUMMAN 
CORPORATION) 13 March 1997 
see abstract 

see page 3, line 2 - page 6, line 3 
7, Ijne 17 - page 9, line 4 



see page 
see page 10, 
see page 13, 
see page 16, 
figures 1-6 



line 31 - page 12, line 1 
line 3 - page 15, line 11 
line 11 - page 17, line 34; 



VINING O.J. ET AL.: "FreeFlight: A 

Virtual Endoscopy System" 

FIRST JOINT CONFERENCE, COMPUTER VISION, 

VIRTUAL REALITY AND ROBOTICS IN MEDICINE 

AND MEDICAL ROBOTICS AND COMPUTER-ASSISTED 

SURGERY PROCEEDINGS, 19 - 22 March 1997, 

pages 413-416, XP002G83447 

Grenoble, France 

see the whole document 

US 5 611 025 A (LORENSEN ET AL. ) 

11 March 1997 

cited in the application 

see abstract 

see column 2, line 36 - column 3, line 35 
see column 4, line 39 - column 5, line 15; 
figures 1-3 



1,48,55 



1,48,55 



39-41 



1,48,55 



Form PCT/ISA/210 (continuation o( second shaat) (Jufy 1992) 



page 2 of 2 



tnformation on patent f amity members 


Int utlonal Application No 

PCT/IL 98/00087 


Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 



wo 9811524 
WO 9709690 



A 
A 



19-03-1998 
13-03-1997 



AU 
AU 



4267897 A 
6917496 A 



02-04-1998 
27-03-1997 



US 5611025 A 11-03-1997 CN 1135047 A 06-11-1996 

DE 19543410 A 27-06-1996 
JP 8252217 A 01-10-1996 



Form PCT/ISA/210 (patent tamDy annex) (July 1992) 



TY 



REC'D 0 6JUN 2000 



'ATENT COOPERATION T 

PCT 

INTERNATIONAL PRELIMINARY EXAMINATION REPORT 

(PCT Article 36 and Rule 70) 



WlPO 



PCT 



Applicant's or agents file reference 


See Notification of Transmittal of International 


032/00391 


FOR FURTHER ACTION Preliminary Examination Report (Form PCT/IPEA/416) 


International a^iplication No. 


International filing date (day/month/year) 


Priority date (day/month/year) 


PCT/IL98/00087 


23/02/1998 


23/02/1998 


International Patent Classification (IPC) or national classification and IPC 




G09B23/28 






Applicant 






ALGOTEC SYSTEMS LTD. et al. 







1 . This international preliminary examination report has been prepared by this International Preliminary Examining Authority 
and is transmitted to the applicant according to Article 36. 

2. This REPORT consists of a total of 5 sheets, including this cover sheet. 

S This report is also accompanied by ANNEXES, i.e. sheets of the description, claims and/or drawings which have 
been amended and are the basis for this report and/or sheets containing rectifications made before this Authority 
(see Rule 70.16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total of 9 sheets. 



3. This report contains indications relating to the following items: 
I S Basis of the report 



It 


□ 


III 


□ 


IV 


□ 


V 




VI 


□ 


VII 


□ 


Vllt 


□ 



citations and explanations suporting such statement 



Date of submission of the demand 
13/07/1999 


Date of completion of this report 

02.06.00 


Name and mailing address of the international 
preliminary examining authority: 

^ European Patent Office 
^ D-80298 Munich 

C^' Tel. 449 89 2399 - 0 Tx: 523656 epmu d 
Fax: +49 89 2399 - 4465 


Authorized officer ^^jjsSS^^j^ 
Watson, S (l ^ /) 

Telephone No. +49 89 2399 2840 



Form PCT/I PEA/409 (cover sheet) (January 1994) 



INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



International application No. PCT/IL98/00087 



I. Basis of the report 

1 This report has been dra\Affi on the basis of (substitute sheets which have been furnished to the receiving Office in 
response to an invitation under Article 14 are referred to in this report as "originally filed" and are not annexed to 
the report since they do not contain amendments,): 

Description, pages: 

1 -25.27-29 as originally tiled 

26 with telefax of 1 5/05/2000 



Claims, No.: 

1-49,57-70 
50-56 



with telefax of 
with telefax of 



13/07/1999 
15/05/2000 



Drawings, sheets: 

1/4-4/4 as originally filed 

2. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 

□ the drawings, sheets: 

3. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 



4. Additional observations, if necessary: 



I 



Form PCT/IPEA/409 (Boxes l-VIII. Sheet 1) (January 1994) 



INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



International application No. PCT/IL98/00087 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 

1. Statement 

Novelty (N) Yes: Claims 1 -70 

No: Claims 

Inventive step (IS) Yes: Claims 1-70 

No: Claims 

Industrial applicability (lA) Yes: Claims 1-70 

No: Claims 



2. Citations and explanations 
see separate sheet 



Form PCT/IPEA/409 (Boxes l-Vlll. Sheet 2) (January 1994) 



INTERNATIONAL PRELIMINARY International application No. PCT/IL98/00087 

EXAMINATION REPORT - SEPARATE SHEET 



V Reasoned statement under Article 35(2) with regard to nove»ty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

D2: Paik David S.: 'Automated flight path planning for virtual endoscopy* Medical 
Physics, vol. 25, no. 5, May 1998, pages 629-637, XP002083445 USA 

1.1 The subject-matter of claims 1 and 55 is novel as none of the available prior art 
discloses a path planning method for a dataset with a cavity and a boundary, 
where the path is automatically determined between start and end points which is 
responsive to a penalty associated with passing through various points in the 
cavity. 

1 .2 Document D2, which is taken as being the closest prior art, shows a method of 
path planning, comprising, providing a (medical imaging) dataset representing a 
cavity and a boundary; providing a plurality of points in said dataset, including at 
least a starting point and an ending point (see page 631, "Initial Path Selection" - 
page 632). 

The subject-matter of claims 1 and 55 differs from this known method in that the 
path is automatically determined between start and end points responsively to a 
penalty associated with passing through various points in the cavity. 

The problem to be solved by this invention is to automatically plan a path which is 
not adversely affected by small errors in the data acquisition by planning a path 
that does not alway lie substantially on the centre-line of the cavity. 

The solution given in claims 1 and 55 is considered to be inventive as it is not 
known or hinted at in the available prior art to use a penalty function associated 
with various cavity points to plan the path. Similarly, the subject-matter of claim 48 
is considered to be novel and inventive as it is not known or hinted at in the prior 
art to provide a method that avoids the medial axis and does not approach the 
boundary in at least two bends. 

2 The subject-matter of claim 53 is considered to be novel and inventive as it is not 
known from the prior art to erode, determine distance and then open dataset as 
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3 Claims 2-47 and 64-70 are dependent on claim 1 and therefore also fulfil the 

requirements of the PCT with regard to novelty and inventive step. Claims 49-52 
are dependent on claim 48, claim 54 is dependent on claim 53 and claims 56-63 
are dependent on claim 55 and therefore also fulfil the requirements of the PCT 
as regards novelty and inventive step. 
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In accordance with a preferred embodiment of the invention, the view is rendered using 
a raycasting method, for example as described in U.S. provisional application titled 
"Raycasting System and Method", filed on February 23, 1998, by applicants S. Akerman and 
G. Miller, the disclosure of which is incorporated herein by reference. Preferably, the distance 
from the boundary which is determined for each point along the path, is used as a lower limit 
for the ray casting algorithm, since there can be no exterior voxels closer than the determined 
distance. 

Although the above methods are generally described as including the planning of all 
the aspects of the path, in a preferred embodiment of the invention, the above described 
methods are used for only some of the aspects. Altematively or additionally, the order of steps 
may be changed and/or steps split into sub-steps and/or combined. In a preferred embodiment 
of the invention, lazy evaluation techniques are utilized, to delay heavy computations and/or 
reduce memory requirements as much as possible. Such computations include, evaluating a 
penalty function and/or constructing a graph. 

In a preferred embodiment of the invention, a user performs real-time control of 
various viewing parameters while viewing a path generated in accordance with a preferred 
embodiment of the invention. Such parameters may include illumination parameters, such as 
position, movement and decay as a function of distance, speed, direction of gaze, angle of 
gaze, field of view size and aspect ratio. 

In accordance with some preferred embodiments of the invention, some of the methods 
described herein are applied in an iterative manner. In one preferred embodiment of the 
invention, a user enters limitations, the system generates a path which attempts to meet these 
limitations and then the user possibly changes these limitation, based on the quality of the 
generated path and/or the generated view. Preferably, at least some of the computations, such 
as distance computations, are performed only once and not repeated each iteration. 
Additionally, preferably not all the limitations need to be entered each iteration. One example 
of user entered limitations is a set of points through which it is desired that the path pass. 

Additionally or altematively, the above described methods may be applied as a post 
processing step to a path generated by other means and/or entered by a user, especially for 
smoothing such a path and/or for calculation of viewing parameters. In one preferred 
embodiment of the invention, only optimal viewing angles and velocities are determined for a 
fixed path. In a preferred embodiment of the invention, the methods are used to select a path 
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CLAIMS 

1 . A method of path planning, comprising: 

providing a medical imaging dataset representing a cavity and a boundary; 
providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
responsive to a penalty associated with passing through various points in the cavity. 

2. A method according to claim 1 , wherein said penalty function is responsive to a 
morphology of the cavity. 

3. A method according to claim 2, wherein said morphology comprises a width. 

4. A method according to claim 2 or claim 3, wherein said morphology is a local 
morphology. 

5. A method according to any of claims 1-4, wherein said penalty function is responsive 
to the path. 

6. A method according to claim 5, wherein said penalty fimction is responsive to an 
amount of local bending of the path. 

7. A method according to any of claims 1-6, wherein automatically determining a path 
comprises automatically detemiining a trajectory of an origin of a viewport. 

8. A method according to any of claims 1-7, wherein providing a plurality of points 
comprises providing a trajectory. 

9. A method according to any of claims 1-8, wherein automatically determining a path 
comprises automatically determining a trajectory of an aiming point. 
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10. A method according to any of claims 1-9, wherein automatically detemiining a path 
comprises automatically determining an angular orientation of a line of sight, relative to a path 
traveled by a viewport origin. 

11. A method according to any of claims 1-9, wherein automatically determining a path 
comprises automatically determining an angular orientation of a line of sight, relative to a path 
traveled by a viewport origin, responsive to a local width of the cavity. 

12. A method according to any of claims 1-9 or 1 1, wherein automatically determining a 
path comprises automatically determining an angular orientation of a line of sight, relative to a 
path traveled by a viewport origin, responsive to a local bend of the path. 

13. A method according to any of claims 1-10, wherein automatically determining a path 
comprises automatically determining at least one viewing parameter along a trajectory of a 
view origin point. 

14. A method according to any of claims 1-13, wherein said penalty depends on a viewing 
quality possible from a point. 

15. A method according to claim 14, wherein said viewing quahty depends on human 
perceptual abilities. 

16. A method according to claim 14 or claim 15, wherein said viewing quality depends on 
a specific task to be performed with said path. 

17. A method according to any claims 1-16, comprising smoothing the path. 

18. A method according to claim 17, wherein said smoothing is dependent on a local width 
of the cavity, at the smoothed portion of the path. 
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19. A method according to any of claims 1-18, comprising automatically repeating at least 
said automatically detemiining a path between said starting and ending points. 

20. A method according to any of claims 1-19, comprising providing at least one user- 
provided limitation on said path determination. 

21 . A method according to claim 1 9, wherein automatically repeating comprises 
automatically repeating automatically determining a path, responsive to at least one user- 
provided limitation. 

22. A method according to claim 20 or claim 21, wherein said at least one limitation 
comprises a rigid limitation. 

23. A method according to any of claims 20-22, wherein said at least one limitation 
comprises a flexible limitation. 

24. A method according to any of claims 20-23, comprising indicating to a user which 
limitations are not met. 

25. A method according to any of claims 1-24, comprising selecting a data granularity 
level for said path determination. 

26. A method according to any of claims 1-25, wherein automatically determining a path 
comprises evaluating a penalty function for the points. 

27. A method according to claim 26, wherein said penalty function is dependent on the 
distance of the point from a boundary of the cavity. 

28. A method according to claim 27, wherein said penalty function is lower for points 
which are further from the boundary. 
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29. A method according to claim 28, wherein said penalty function has a substantial rate of 
increase when approaching said bovmdary. 

30. A method according to claim 28 or claim 29, wherein said penalty function has a low 
rate of change away from said boundary. 

31. A method according to any of claims 27-30, comprising deterniining said distance by 
erosion of the dataset. 

32. A method according to any of claims 27-30, comprising determining said distance by 
wave propagation icova the boundaries of said cavity. 

33. A method according to any of claims 1-32, wherein said determining a path comprises 
determining a relatively short path. 

34. A method according to claim 33, wherein a relatively short path comprises a shortest 
path which takes into consideration the penalty value associated with the various locations. 

35. A method according to claim 33 or claim 34, wherein automatically determining a path 
comprises generating a graph representing at least a portion of the cavity. 

36. A method according to claim 35, wherein said path is detennined by applying a path 
finding method to the graph and wherein said portions of said graph are generated only when 
needed by said method. 

37. A method according to claim 35 or claim 36, wherein automatically determining a path 
comprises determining a path using Dijkstra's shortest path finding method on said graph. 

38. A method according to any of claims 35- 37, wherein said graph includes only a subset 
of voxels in said cavity. 
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39. A method according to claim 38, wherein said graph comprises substantially only a 
skeleton of said cavity. 

40. A method according to claim 39, wherein said skeleton is found utilizing data from 
erosion of the cavity, which erosion is utilized to determine a distance of interior points from 
said boundary. 

41 . A method according to any of claims 1-40, wherein said dataset is represented by 
voxels. 

42. A method according to any of claims 1-41, wherein said boundary is represented by 
polygons. 

43. A method according to any of claims 1-42, wherein said dataset comprises a CT 
dataset. 

44. A method according to any of claims 1-42, wherein said dataset comprises an MRI 
dataset. 

45. A method according to any of claims 1-42, wherein said dataset comprises a NM 
dataset. 

46. A method according to any of claim 1-45, wherein said boimd^uy has small holes 
therein and wherein said path does not pass through holes narrower than a predetemiined 
width. 

47. A method according to claim 46, wherein said predetemiined width is dependent on a 
morphology of the cavity. 

48. A method of path planning, comprising: 

providing a medical dataset representing a cavity having a plurality of bends and a 
boundary; 
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providing a plurality of points in said dataset, including at least a starting point and an 
ending point; 

automatically determining a path between the starting point and the endmg point, 
wherein said path does not remain substantially in a medial axis of the cavity and does not 
5 approach closer than a predetermined distance to said boundary, in at least two of said bends. 

49. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does not approach closer than one voxel to said boundary. 

10 50. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does not approach closer than three voxels to said boundary. 

5 1. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does not approach closer than one tenth the local width of said cavity, to said 

15 boimdary. 

52. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does pass through holes in said boundary which are narrower than a 
predetermined width. 

20 

53 . A method of skeletonizing a dataset including a cavity and a boundary thereof, 
comprising: 

eroding said cavity, using balls of increasing radius R; 

determining a distance of points interior to the cavity, from the boundary, utilizing said 
25 erosion; 

opening said eroded cavity, for each radius R, using a ball of radius 1; and 
accumulating the points which are removed from said eroded cavity by said opening, to 
form a skeleton. 

30 54. A method according to claim 53, wherein erosion by a ball R comprises eroding the 
result of eroding with a ball of radius R-1, with a ball of radius 1. 
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55 . A method of path planning, comprising: 

providing a dataset representing a cavity and a boundary; 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
responsive to a penalty associated with passing through various points in the cavity. 

56. A method according to claim 55, wherein said penalty function is responsive to a width 
of the cavity. 

57. A method according to claim 55 or claim 56, wherein said penalty function is 
responsive to an amount of local bending of the path. 

58. A method according to any of claims 55-57, wherein automatically determining a path 
comprises evaluating a penalty function for the points. 

59. A method according to claim 58, wherein said penalty function is dependent on the 
distance of the point from a boundary of the cavity. 

60. A method according to claim 59, wherein said penalty function is lower for points 
which are further from the boxmdary. 

61 . A method according to any of claims 55-60, wherein said detemiining a path comprises 
determining a relatively short path. 

62. A method according to claim 61 , wherein a relatively short path comprises a shortest 
path which takes into consideration the penalty value associated with the various points. 

63. A method according to claim 61 or claim 62, wherein automatically determining a path 
comprises generating a graph representing at least a portion of the cavity and wherein said path 
is determined by applying a path finding method to the graph and wherein said portions of said 
graph are generated only when needed by said method. 
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AUTOMATIC PATH PLANNING SYSTEM AND METHOD 
FIELD OF THE INVENTION 

The present invention relates to the display of three-dimensional medical imaging data 
sets, and in particular to automatic path selection for virtual endoscopy. 

BACKGROUND OF THE INVENTION 
In many medical situations it is necessary to obtain views of elongate cavities within 
the body, from within the cavities. Some common examples include blood vessels, intestines 
and the bronchi. An endoscope (and other, similar devices, collectively referred to herein as 
endoscopes) is a device which can be inserted into such a cavity and through which a small 
portion of the cavity can be viewed in real-time and with high-resolution. 

Using physical endoscopes raises several problems. First, even though the endoscopic 
procedure is minimally invasive, it still involves inserting a surgical instrument into the body, 
which is both dangerous and painful. In addition, forcing a passage from the outside of the 
body and into the elongate cavity may cause tissue damage. Another problem is that the field 
of view and maneuverability of the endoscope are limited. Since the precise position of the 
endoscope and the point of view of the endoscope are difficult to determine, navigating in the 
body using an endoscope is difficult. This difficulty is paramount in inspection procedures, for 
example in colonscopy, where it is important to be sure that the entire colon was properly 
inspected. 

A parallel procedure, known as virtual endoscopy, has been suggested, for example in 
U.S. Patents 5,611,025 and 5,458,111, the disclosures of which are incorporated herein by 
reference. In virtual endoscopy the body is imaged using a three-dimensional medical imaging 
device, such as an ultrasound imager, nuclear medicine camera, magnetic resonance imager or 
a X-Ray computerized tomography scanner, to create a three-dimensional data set. Then, a 
graphics processor reconstructs views of internal cavities from the image data, as would have 
been viewed by a virtual endoscope traveling along a path in the cavity. 

Manual planning of the path is a long process and while it might sometimes be 
desirable that the attending physician perfomi this task, he will seldom have the time to do so. 

Two types of automatic path planning, where a user enters a starting point and an 
ending point and a computer generates a path connecting the two points, are known in the art. 
The above referenced 5,611,025 patent describes a method which detemiines a shortest path 
between two points in a tissue cavity, which path avoids obstacles, and which path may also be 



1 



wo 99/42977 PCT/IL98/00087 

smoothed. However, such a path may pass very close to the obstacles. Another type of path 
planning method, shown for example in WWW Document 
"http://indigo2.rad.bgsm.edu/software/cp", the disclosure of which is incorporated herein by 
reference, attempts to plan a path along the middle of the passage, i.e., along a line known as 

5 the medial axis of the cavity. In one described embodiment, a plurality of medial axis paths are 
generated for a colon with a constriction (each path passing on a different side of the 
constriction) and a user selects the path which lets him see the most of the colon. One 
limitation of medial axis following is that the medial axis is not smooth, but is affected by the 
morphology of the passage, even if the passage is very wide. Thus, a bump in the passage wall 

10 causes a bump in the path. 

SUMMARY OF THE INVENTION 

It is an object of some embodiments of the present invention, to provide a method of 
automatic path planning for virtual endoscopy. Preferably, the planned path is used to generate 
a plurality of frames which can be viewed as a cine sequence. 

1 5 Another object of some embodiments of the present invention is to provide a method of 

path planning which is based on a pluraUty of factors. Preferably, a penalty is assigned to each 
potential point along a path, for each factor, depending on the relative importance of the factor 
and/or on a deviation from the ideal value for the factor. Preferably, at least some of the factors 
are evaluated locally, for example, a distance of a point along the path from the boundary. 

20 Alternatively or additionally, at least some of the factors are evaluated globally, for example, 
the length of the path. In a preferred embodiment of the invention, the penalty assigned for 
each factor is dependent on the morphology of the cavity, preferably the local morphology, 
such as the width. Alternatively or additionally, the penalty is dependent on characteristics of 
the path itself 

25 In accordance with a preferred embodiment of the invention, the factors may include 

one or more of: distance of path from the cavity boundary, sharpness of bends in the path, 
length of path, amount of twist of a generated field of view, viewing of certain desired points 
on the cavity boundary, speed of motion of viewed points, smoothness of path and amount of 
change between consecutive images. In a preferred embodiment of the invention, at least some 

30 of the factors are related to a comfort of viewing and/or quality of viewing. Alternatively or 
additionally, at least some of the factors are related to a diagnostic use of the generated view. 
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In accordance with a preferred embodiment of the invention, path planning includes 
one or more of: planning a trajectory of motion and/or velocity profile for a view origin point, 
planning a trajectory of motion and/or orientation for a line of sight from the view origin and 
planning viewing parameters for points along the trajectory. It should be appreciated that in 
some cases the view origin may be stationary, while the line of sight is in motion and vise- 
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15 



20 



versa. 



25 



30 



Another object of some preferred embodiments of the invention is to provide a method 
of planning a path for virtual endoscopy, in which the path is not Umited to remaining in 
substantially the middle of a cavity through which the path passes. In a preferred embodiment 
of the invention, the path does not pass too close to the boundaries of- and/or obstacles in- the 
cavity. 

Another object of some embodiments of the present invention is to provide a method of 
planning a path which is not adversely affected by small errors in the acquisition of the data, 
especially not affected by small holes in the boundary of the cavity. 

Another object of some embodiments of the present invention is to provide a method of 
path planning for virtual endoscopy, in which the method is functionally dependent on 
morphological features of the cavity and/or of a path therethrough. In one preferred 
embodiment of the invention, the width of the passage is used for determining a desired 
amount of smoothing of a path. Alternatively or additionally, the width of the passage is used 
for determining a desired granularity of data and/or resolution of calculation for one or more 
steps of the method. 

Another object of some embodiments of the present invention is to provide a method of 
path planning which directly uses voxel data, thereby avoiding the necessity to generate a 
surface representation and possibly add errors. 

A method of path planning in accordance with a preferred embodiment of the 
invention, preferably includes at least some of the following steps: 

(a) providing a three dimensional image data set, which includes a cavity; 

(b) selecting a plurality of points, including at least a starting point and an ending 

point; 

(c) determining a relatively direct and relatively short path between the starting point 
and the ending point, which path preferably takes into account the desirability of passing 
through different voxels of the cavity; 
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(d) optionally, smoothing the determined path; 

(e) detemiining viewing parameters for each point along the path, preferably taking 
into account the distance of points along the path from the boundaries of the cavity and/or 

characteristics of the path; 

(f) determining a rate of motion along the path, preferably for each point along the 
path, preferably taking into account the distance of points along the path from the boundaries 
of the cavity and/or characteristics of the path; and 

(g) optionally, optimizing the path. 

In a typical embodiment of the invention, the image data set is a CT or MRI data set 
which is then segmented to yield information regarding cavities. In one preferred embodiment 
of the invention, a patient is injected with a blood contrast medium and then imaged using a 
CT device. The resulting three-dimensional data set is segmented using CT numbers, to 
differentiate between the contrast-enhanced blood and the other tissues. The area with the CT 
numbers corresponding to the blood is treated as a cavity. As can be appreciated, once an 
15 image is segmented, any portion of it can be defined as being "interior", i.e., a cavity and any 
other portion as being solid, i.e., "exterior". One example is nerve tissue vs. bone tissue in the 
spine. The boundary is a mathematical constmct which defines the border between solid 
voxels and transparent voxels. As explained below, some preferred embodiments of the 
invention are especially forgiving with regard to the quality of the segmentation, especially if 
20 there are small holes in the boundary. Preferably, the area of interest is also limited to a region 
of interest select by a user. Alternatively or additionally, only voxels which are connected to 
the starting and ending points via "interior" voxels are considered to be in the cavity. 

Typically, the above described method is implemented in a post-processing graphics 
station, which is preferably part of a medical imaging system. Alternatively, the station may be 
25 a separate viewing station. 

In accordance with a preferred embodiment of the invention, the path determination is 
performed using a lower resolution and/or a different discretization grid than that of the voxel 
data and/or the resolution of the actual motion. For example, the path determination may be 
made in a grid having a unit size of more than one voxel, while the actual movement during 
30 the generated virtual endoscopy view may have a step size of half a voxel. Thus, in a preferred 
embodiment of the invention, there is a step of transforming from the grid used for path 
determination to the grid used for the actual motion. Preferably, this step is done before 
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performing the smoothing. Alternatively, this step may be delayed, possibly even as late as the 
determination of the location of each viewing origin for each generated frame of the view. In a 
preferred embodiment of the invention, the smoothing is performed in a voxel type grid. 
Preferably, the determination of points at which views are generated, is performed by sampling 
5 and/or interpolating (preferably using a floating point notation) between whole voxel 
locations. 

As used herein, the term "granularity" is used to refer to the size of voxels in a data set. 
The term "point" is used to refer to a location in the data set. 

In a preferred embodiment of the invention, step (c) above is performed by applying an 
10 algorithm which finds a shortest distance path between the starting point and the ending points. 
However, instead of using a standard Euclidean distance function to determine a distance 
between two points in the cavity, the distance function preferably takes into account the 
desirability of the path going through a particular point in the cavity, by assigning different 
penalties to different points in the cavity. In one preferred embodiment of the invention, a 
15 penalty function depends only on the point itself, for example, the distance between the point 
and the nearest boimdary, or another relationship between the point and the morphology of the 
cavity, such as the amoimt of local bend in the cavity. Preferably, only the local morphology is 
used for such a penalty function. 

Additionally or alternatively, the penalty value associated with a point may depend on 
20 the path chosen or a portion of the path, for example, the amount of twist in the path. In a 
preferred embodiment of the invention, a relatively short duration is desired for the travel 
along the path. Thus, points which reduce the duration are preferred over points which increase 
the duration. In one example, the velocity of motion allowed through a certain point may be 
inversely dependent on the amount of bending in the path. Thus, points which increase the 
25 bend, increase the duration and have a lower desirability even though they shorten the path. 

Alternatively or additionally, the penalty value associated with a point depends on the 
quality of a view possible from that point. The quality of view may depend on, inter alia, 
inclusion of points whose viewing is required, angular resolution of such points, available 
contrast, which is dependent on desired rendering parameters, angle between the point of view 
30 and the surface including the point of interest, angular size of such points of interest and type 
of movement of the view aiming point, while viewing. 
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In some preferred embodiments of the invention, the required quality of view is 
determined responsive to a required diagnostic activity at the points. Alternatively or 
additionally, the required quality of view is a user defined parameter, which preferably 
incorporates perceptual aspects of vision. In a preferred embodiment of the invention, the 
5 penalty value associated with a point depends on the rate of motion allowed through the point, 
which in turn may depend on the quality of the view desired. Alternatively or additionally, the 
point of view is determined based on the relative amount of time that certain portions of the 
cavity will be viewed as compared to other portions of the cavity. Locally modifying the 
velocity of the advance along the path changes the relative time that different parts of the 

1 0 cavity are viewed. 

Thus, it can be appreciated that in accordance with some preferred embodiments of the 
invention, the path between the starting point and the ending point will not usually be the 
shortest possible path. 

Although the above method has been described as including a multitude of steps, it 
15 should be appreciated that in some preferred embodiments of the invention, various of the 
steps may be combined and/or divided and/or their order changed. In a preferred embodiment 
of the invention, the content which the user desires to view; in particular, the content and 
quality of view which the user desires may determine the points along the path at which views 
are to be generated. In one preferred embodiment of the invention, the smoothing step is 
20 performed after the points of view are determined. Additional or aUematively, steps (e) and (f) 
are switched, so that the points of view are determined responsive to the desired velocity and 
the viewing parameters are determined only for these actual points of view. Altematively or 
additionally, the selection of the actual points of view may be made dependent on the amount 
of local bend in the path and/or on other parameters, as described herein. 
25 In preferred embodiments of the invention, only some of the steps of the method are 

apphed. In one example, the path is provided by a user and the above described method is used 
only for determining the motion of the view aiming point. In another example, the above 
described method is used to check a user suppUed path. In another example, the above 
described method may be used to add a point in the middle of an existing path and/or to 
30 change the trajectory of a view aiming point of an existing path. 

In accordance with another preferred embodiment of the invention, the above described 
method is used in a semi-automatic manner. Preferably, the method suggests a path which 
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meets, preferably at least semi-optimally, various restrictions proposed by a user. In one 
example, a user can specify a cavity, a plurality of goal points, a plurality of points to be 
viewed, a minimum allowed distance between a path and a boundary of the cavity. The 
method will generate a suggested path, preferably indicating points along the path and/or 
5 viewed areas which do not meet the requirements. Alternatively or additionally, the user might 
specify points of interest which should be viewed under good viewing conditions. In this and 
other embodiments, the method preferably indicates points which will not be viewed. 
Altematively or additionally, the method preferably indicates points which are viewed for too 
short a time and/or which move along the viewing area on the screen at a velocity above a 
1 0 maximum allowed velocity (angular velocity) 

In preferred embodiments of the invention, at least one of two types of restrictions may 
be supplied, rigid and flexible. Rigid restrictions may not be violated. Flexible restrictions may 
be violated, for a penalty, however, it is generally preferred that they not be violated (if 
possible). For example, a flexible restriction on the path, to be at least 3 voxels away from a 
15 boundary, will take part in a tradeoff with the allowed amount of bending in the path. A rigid 
restriction will not allow such a tradeoff and will cause a larger amount of bending in the path. 
As can be appreciated, overly rigid restrictions may cause some of the above described 
methods to fail in finding a path. Preferably, rather than fail, the system requests a user to 
soften or delete certain limitations. Altematively, the system automatically proposes a 
20 minimally violating path which violates a minimum of rigid restrictions. Preferably, the rigid 
restrictions are ranked. Preferably, the system indicates to the user if any rigid restrictions were 
violated in a particular path. Preferably, the violating path is shown to the user so that he can 
assess the effects of the violation. 

In accordance with a preferred embodiment of the invention, the penalty function is 
25 dependent on the distance of voxels from the boundary of the cavity. In one preferred 
embodiment of the invention, the penalty function is strongly prejudiced against voxels which 
are close to the boundary, but voxels which are over a certain minimum distance from the 
boimdary may have a substantially same penalty. One example of such a function is one 
exponentially inversely related to the actual distance. In another example, there is a distance 
30 cutoff, above which the function is a constant. Altematively, the penalty function may be 
calculated using a look-up table. 
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In one preferred embodiment of the invention, the distance from the boundary of the 
cavity is calculated by a wave propagation method from the boundaries. In accordance with 
another preferred embodiment of the invention, the distance is calculated by sequentially 
eroding the cavity with balls of increasing radius, whereupon at each radius step, all the un- 
eroded voxels are marked as having a distance of at least the eroding radius. In a preferred 
embodiment of the invention, erosion with large balls is approximated by erosion with a 
plurality of small balls, whose sum of radii equals the radius of the large ball. In a preferred 
embodiment of the invention, at least some steps of the erosion process are performed by 
eroding the result of a previous step with a small ball (having a radius smaller than r, the 
current step). 

In accordance with a preferred embodiment of the invention, not all the voxels in the 
data set are taken into accoimt, as possible points along the path, when plaiuiing the path. 
Preferably a subset of the points is selected, such that the computational complexity of path- 
finding may be substantially reduced. In a preferred embodiment of the invention, voxels 
which would probably not form part of the path, for example as a result of having a high 
penalty, are removed from consideration. In a preferred embodiment of the invention, such a 
subset of voxels is generated by skeletonization. Skeletonization is a process which attempts to 
reduce the mmiber of voxels in an object, while maintaining the morphological features of the 
object. The product of the skeletonization process is a set of voxels which are at centers of 
maximal balls which can fit into the cavity. This set in not necessarily connected. Further, 
since many voxels are dropped, it is possible that a voxel will not have any neighbors. In a 
preferred embodiment of the invention, neighbors of a voxel, for purposes of path 
determination, are considered to be those voxels within a short distance. Preferably, a 
determination is made whether there is a short path between the two points which only passes 
through interior voxels. This distance is preferably dependent on the distance of the voxel from 
the boimdary and/or on the typical width of the cavity. Alternatively, the distance to many 
points may be determined, for each voxel in the skeleton. 

In a accordance with a preferred embodiment of the invention, skeletonization is 
perfomied based on the results from each stage of erosion. In one preferred embodiment of the 
invention, an skeletonization of radius r is achieved by first eroding with a ball with radius r, 
then opening (eroding + dilating) with a ball of radius 1, i.e., by dilating the result of the r+1 
eroding step, described above. 
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In accordance with a preferred embodiment of the invention, the data set granularity is 
reduced, to increase the speed of the algorithm. In accordance with one preferred embodiment 
of the invention, the granularity is reduced by a fixed ratio. Alternatively or additionally, the 
granularity is reduced by different ratios, for different parts of the image data, preferably, 
5 depending on the morphology of the cavity. Alternatively or additionally, the granularity is 
chosen responsive to a narrowest passage through which the path passes. Accordingly, in a 
preferred embodiment of the invention, a preliminary non-optimal path is determined, to 
assess path passage characteristics which may affect the desired granularity. A final granularity 
is then preferably determined, using the determined characteristics, for use with an optimal 
10 path finding method. 

In a preferred embodiment of the invention, the granularity does not affect all the steps 
of the algorithm. In one preferred embodiment of the invention, the granulation is embodied 
by determining the step size and/or the minimal radius used in the erosion and/or 
skeletonization step. Alternatively or additionally, the local granularity is made inversely 
15 related to the penalty function, in the path finding step. Preferably, in voxels where there are 
large changes in the penalty function and/or where the penalty function is high, the granularity 
is finer. Preferably, the granularity is anisotropic. 

In a preferred embodiment of the invention, the amount and/or type of smoothing is 
dependent on the local width of passages. Path portions which pass through narrow passages 
20 are preferably not smoothed at all, to reduce the chance of the path entering a cavity boimdary 
and/or passing to close to a boimdary. 

In a preferred embodiment of the invention, the line of sight for viewing is determined 
using the viewing origin and an aiming point, aroimd which a viewport is preferably centered. 
Preferably, the aiming point is along the path. Preferably, the distance between the viewing 
25 origin and the aiming point is dependent on the amount of local bending and/or on the distance 
to the nearest boundary in the path. Preferably, the distance between the viewing origin and the 
aiming point is determined in such a manner as to maintain the twisting of the viewport below 
a certain level. 

In a preferred embodiment of the invention, a user can control some or all of the 
30 viewing parameters while the view is being generated. Such control preferably includes one or 
more of: stopping the motion of the viewing origin, changing its velocity and/or the overall 
velocity of the viewing origin, marking points of interest, changing the aiming point and/or its 
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trajectory of motion and changing the viewport. Preferably, the user can continue the 
generation of the view from the point at which he started deviating from the original planned 
path. 

It should be appreciated that various aspects of the present invention are not related to 
voxel-type data representation and/or to any particular shape and/or consistency of size of the 
voxels. In a preferred embodiment of the invention, the image data is manipulated, at least in 
part, as polygons which describe surfaces, rather than as voxels. In such a case the path is 
preferably determined utilizing a resolution grid, rather than based on a voxel size, as in some 
other preferred embodiments of the invention. 

There is therefor provided in accordance with a preferred embodiment of the invention, 
a method of path planning, comprising: 

providing a medical imaging dataset representing a cavity and a boundary; 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
responsive to a penalty associated with passing through various points in the cavity. 

Preferably, said penalty function is responsive to a morphology of the cavity. 
Preferably, said morphology comprises a width. Alternatively or additionally, said morphology 
is a local morphology. 

In a preferred embodiment of the invention, said penalty function is responsive to the 
path. Preferably, said penalty function is responsive to an amount of local bending of the path. 

In a preferred embodiment of the invention, automatically determining a path 
comprises automatically determining a trajectory of an origin of a viewport. 

In a preferred embodiment of the invention, providing a plurality of points comprises 
providing a trajectory. Alternatively or additionally, automatically determining a path 
comprises automatically determining a trajectory of an aiming point. Alternatively or 
additionally, automatically determining a path comprises automatically determining an angular 
orientation of a line of sight, relative to a path traveled by a viewport origin. Alternatively or 
additionally, automatically determining a path comprises automatically determining an angular 
orientation of a line of sight, relative to a path traveled by a viewport origin, responsive to a 
local width of the cavity. Alternatively or additionally, automatically determining a path 
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comprises automatically deteraiining an angular orientation of a line of sight, relative to a path 

traveled by a viewport origin, responsive to a local bend of the path. 

Altematively or additionally, automatically detemiining a path comprises automatically 

deteraiining at least one viewing parameter along a trajectory of a view origin point. 
5 Altematively or additionally, said penalty depends on a viewing quality possible from a point. 

Preferably, said viewing quality depends on human perceptual abilities. Altematively or 

additionally, said viewing quahty depends on a specific task to be perfomied with said path. 

In a preferred embodiment of the invention, the method includes smoothing the path. 

Preferably, said smoothing is dependent on a local width of the cavity, at the smoothed portion 
10 of the path. 

In a preferred embodiment of the invention, the method includes automatically 
repeating at least said automatically detemiining a path between said starting and ending 
points. 

In a preferred embodiment of the invention, the invention includes providing at least 
15 one user-provided limitation on said path determination. Preferably, automatically repeating 
comprises automatically repeating automatically determining a path, responsive to at least one 
user-provided limitation. Altematively or additionally, said at least one limitation comprises a 
rigid limitation. Altematively or additionally, said at least one limitation comprises a flexible 
limitation. Altematively or additionally, the method comprises indicating to a user which 

20 limitations are not met. 

In a preferred embodiment of the invention, the method comprises selecting a data 
granularity level for said path determination. Altematively or additionally, automatically 
determining a path comprises evaluating a penalty function for the points. Preferably, said 
penalty function is dependent on the distance of the point from a boundary of the cavity. 
25 Preferably, said penalty function is lower for points which are further from the boundary. 
Altematively or additionally, said penalty function has a substantial rate of increase when 
approaching said boundary. Altematively or additionally, said penalty function has a low rate 
of change away from said boundary. Altematively or additionally, the method comprises 
determining said distance by erosion of the dataset. Altematively, the method comprises 
30 determining said distance by wave propagation from the boundaries of said cavity. 

In a preferred embodiment of the invention, said determining a path comprises 
determining a relatively short path. Preferably, a relatively short path comprises a shortest path 
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which takes into consideration the penalty value associated with the various locations. 
Alternatively or additionally, automatically detennining a path comprises generating a graph 
representing at least a portion of the cavity. Preferably, said path is determined by applying a 
path finding method to the graph and wherein said portions of said graph are generated only 
when needed by said method. Alternatively or additionally, automatically determining a path 
comprises determining a path using Dijkstra's shortest path finding method on said graph. 
Alternatively or additionally, said graph includes only a subset of voxels in said cavity. 
Preferably, said graph comprises substantially only a skeleton of said cavity. Preferably, said 

skeleton is found utilizing data from erosion of the cavity, which erosion is utilized to 

determine a distance of interior points from said boundary. 

In a preferred embodiment of the invention, said dataset is represented by voxels. 

Alternatively or additionally, said boundary is represented by polygons. Alternatively or 

additionally, said dataset comprises a CT dataset. Alternatively or additionally, said dataset 

comprises an MRI dataset. Alternatively or additionally, said dataset comprises a NM dataset. 
In a preferred embodiment of the invention, said boundary has small holes therein and 

wherein said path does not pass through holes narrower than a predetermined width. 

Preferably, said predetermined width is dependent on a morphology of the cavity. 

There is also provided in accordance with a preferred embodiment of the invention, a 

method of path planning, comprising: 

providing a medical dataset representing a cavity having a plurality of bends and a 

boundary; 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; 

automatically determining a path between the starting point and the ending point, 
wherein said path does not remain substantially in a medial axis of the cavity and does not 
approach closer than a predetermined distance to said boundary, in at least two of said bends. 

Preferably, said dataset is represented using voxels and wherein said path does not 
approach closer than one voxel to said boundary. Alternatively, said dataset is represented 
using voxels and wherein said path does not approach closer than three voxels to said 
boundary. Alternatively, said dataset is represented using voxels and wherein said path does 
not approach closer than one tenth the local width of said cavity, to said boundary. 
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Alternatively, or additionally, said dataset is represented using voxels and wherein said path 
does pass through holes in said boundary which are narrower than a predetermined width. 

There is also provided in accordance with a preferred embodiment of the invention, a 
method of skeletonizing a dataset including a cavity and a boundary thereof, comprising: 
eroding said cavity, using balls of increasing radius R; 

determining a distance of points interior to the cavity, from the boundary, utilizing said 
erosion; 

opening said eroded cavity, for each radius R, using a ball of radius 1 ; and 
accumulating the points which are removed from said eroded cavity by said opening, to 
form a skeleton. 

Preferably, erosion by a ball R comprises eroding the result of eroding with a ball of 
radius R-1, with a ball of radius 1. 

There is also provided in accordance with a preferred embodiment of the invention, a 
method of path planning, comprising: 
1 5 providing a dataset representing a cavity and a boundary; 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
responsive to a penalty associated with passing through various points in the cavity, 

20 Preferably, said penalty fimction is responsive to a width of the cavity. Altematively or 

additionally, said penalty function is responsive to an amount of local bending of the path. 
Altematively or additionally, automatically determining a path comprises evaluating a penalty 
function for the points. Preferably, said penalty function is dependent on the distance of the 
point from a boundary of the cavity. Preferably, said penalty function is lower for points which 

25 are further from the boundary. 

In a preferred embodiment of the invention, said determining a path comprises 
determining a relatively short path. Preferably, a relatively short path comprises a shortest path 
which takes into consideration the penalty value associated with the various points. 
Altematively or additionally, automatically determining a path comprises generating a graph 

30 representing at least a portion of the cavity and wherein said path is determined by applying a 
path finding method to the graph and wherein said portions of said graph are generated only 
when needed by said method. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be more clearly understood from the following detailed 
description of the preferred embodiments of the invention and from the attached drawings, in 
which: 

Fig. 1 A is a schematic illustration of a three-dimensional data set, including a cavity 
and a path through the cavity; 

Fig. IB is a schematic illustration of a view seen through a viewport on a particular 
point along the path of Fig. lA; 

Fig. 2 is a flowchart of a method of path planning, in accordance with a preferred 
embodiment of the invention; 

Fig. 3 is a flowchart of a method of finding a short path between two voxels, in 
accordance with a preferred embodiment of the invention; 

Fig. 4 is a flowchart of a method of calculating a distance fimction between each point 
in a cavity and the boundaries of the cavity, in accordance with a preferred embodiment of the 
invention; 

Fig. 5A is a schematic illustration of a skeletonized cavity, in accordance with a 
preferred embodiment of the invention; and 

Fig. 5B is a flowchart of a method of skeletonization, in accordance with a preferred 
embodiment of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. lA is a schematic illustration of a three-dimensional data set 10, including a cavity 
14 and a path 16 through the cavity. Data set 10 usually comprises a plurality of image slices 
12, however, in many cases, it is desirable to view portions of the data set, as seen from a view 
origin point 22 along path 16. This view is defined by a view origin point 22 staring at a view 
aiming point 24 through a viewport 26. In some cases, it may be more convenient to describe 
the viewport as being centered around a line of sight between the view origin point and the 
aiming point. It should be appreciated that the view may be clipped, so that voxels that are 
very close to the view origin point are not viewed. In an orthogonal projection, the view origin 
point can be in one of many places along the line of sight, however a fixed location is usually 
supplied. Fig. IB is a schematic illustration of a view 28 seen through viewport 26. 
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A system, in accordance with some preferred embodiments of the invention, provides 
automatic and/or semi-automatic methods of planning a path, such as path 16, so as to best 

view portions of data set 10. 

The actual view when traveling along path 16 is affected of a plurality of variables, 

5 including: 

(a) the trajectory, angular orientation and velocity profile of view origin 22; 

(b) the trajectory, angular orientation and velocity profile of view aiming point 24; 

(c) viewport parameters, such as size, aspect ratio and distortion type and amount; and 

(d) additional information displayed in conjunction with data fi-om data set 10. 

10 In accordance with a preferred embodiment of the invention, it is desirable that the 

generated view be such that it aids diagnosis, maintains spatial orientation, takes into account 
human perceptual abilities and/or human viewing comfort. Preferably, the generated view is 
made more optimal by taking into account the particular characteristics of cavity 14, path 16, 
data set 10, a required use for the generated view and/or desired "illumination" characteristics, 

15 including intensity, location, movement, fog and decay with distance. In a preferred 
embodiment of the invention, the generated view is used as an aid for surgery, for example, for 
rehearsing for a surgical procedure or even during surgery, to aid in orientation and tissue 
identification. 

In a preferred embodiment of the invention, the quality of the generated view is 
20 required to meet certain criteria and/or a composite criterion, at each point thereof 
Alternatively or additionally, an average criterion is set, such that the entire path as a whole 
must meet certain standards. One example of an average criteria arises when determining the 
velocity of motion along path 16. An existing velocity profile may be multipUed by a factor so 
that the average viewing quality is at a predetermined level. AUematively, the factor may be 
25 chosen so that the worst point along the path, or that no more than a predetermined percentage 
of the path, has a lower than desired viewing quaUty. 

Fig. 2 is a flowchart of a method of path planning, in accordance with a preferred 
embodiment of the invention. A plurality of goal points are chosen (30), which preferably 
includes at least a starting point 18 and an ending point 20 (Fig. lA). Alternatively or 
30 additionally to goal points, other restrictions, such as described below, may be entered. 
Responsive to the required path planning task, the data is then preferably preprocessed (32), 
for example by selecting a granularity or by segmenting the data into cavity and non-cavity 
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tissues. In some preferred embodiments of the invention, at least part of the preprocessing, for 
example the segmentation, is performed prior to the selection of restrictions. 

Although, in the subject, the boundary of a cavity is usually differentiated, many 
medical imaging techniques do not have a sufficient resolution to separate the thin boundary 
5 tissues. Rather, the boundary is typically treated as a mathematical surface one side of which 
includes only voxels of the interior of cavity and on the other side of which includes only 
voxels of the exterior of the cavity. Thus, any transition between interior voxels and exterior 
voxels must penetrate a boundary. 

In a preferred embodiment of the invention, a penalty fiinction is evaluated for at least 
10 some of the voxels in the cavity (34) before or during the determination of the path. Thus, it 
needs to be evaluated only once for a plurality of path planning sessions in the same cavity. 
However, in some preferred embodiments of the invention, the penalty fimction may be 
evaluated while determining the path. Alternatively, a penalty function may be evaluated prior 
to selecting at least some of the restrictions on the path. In a preferred embodiment of the 
15 invention, the penalty fimction is based on a typical width of the cavity. In one preferred 
embodiment of the invention the typical width is defined globally. Preferably the typical width 
is the average between half the maximum radius used for erosion and the number of erosion 
steps required to remain with only half the voxels un-eroded. Alternatively, the typical width is 
defined locally, for example by averaging only over the voxels included in a maximum ball 
20 which includes the current voxel (for which the local typical width is being determined). In a 
preferred embodiment of the invention, where the typical width is 5, the penalty fimction has 
the following dependency on the distance from the boundary: 



25 
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In a preferred embodiment of the invention, the penalty fimction is evaluated only 

when required and not calculated in advance for the entire data set. hi one preferred 
embodiinent of the invention, arcs are connected and vortexes added to the graph only if 
necessary, and only then does a penalty fimction need to be evaluated. Further, the distance 
may also be calculated using lazy evaluation techniques, especially, if the data is stored using a 

polygonal representation. 

Using the penalty fimction, a path is determined (36). A certain voxel is included in the 
path depending on the relative penalty of that voxel as compared to other available. 
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neighboring voxels. Preferably, the path is determined using Dijkstra's method for finding a 
short path. In this embodiment, the penalty is preferably taken into account as a weight on an 
arc connecting the current voxel with the growing end of the path. This method is described in 
"Data Structures and Algorithms", by A. V. Aho, J. E. Hopcrofl and J. D. Ubnan, pp. 203-208, 
published by Addison- Wesley in 1983, the disclosure of which is incorporated herein by 
reference. In some preferred embodiments of the invention, for example where a penalty is 
assigned for sharp bends in the path, the penalty fimction is a function of the path, so that it 
must be evaluated in conjimction with the path determination. In some preferred embodiments 
of the invention, other types of path determination methods are used. It should be appreciated 
that in some cases a shortest path, even with respect to the penalty function, will not be found, 
rather a significantly short path will be found. 

Fig. 3 is a flowchart of a method of finding a short path between two voxels, preferably 
with a low overall penalty, in accordance with a preferred embodiment of the invention. The 
voxels through which the path can pass are organized into a graph, where each voxel is a 
vortex and arcs are defined connecting neighboring voxels. In a preferred embodiment of the 
invention, the weight of the arcs are determined by the penalty function. Additionally or 
alternatively, the weight may take into account the real distance between voxels centers, 
however, in some preferred embodiments of the invention, the distance between neighboring 
voxels is defined to be a unit length. In skeletonization embodiments of the invention, the arc 
weight preferably takes into account, the penalty associated with all the voxels between the 
two voxels fi-om the skeleton. Alternatively, the penalty at one or both of the voxels is 
multiplied by the distance between the voxels. In some preferred embodiments of the 
invention, the penalty function describes the desirability of the path going between two 
neighboring voxels, rather than the desirability of the path passing through a particular voxel. 
In some preferred embodiments of the invention, some voxels have no penalty assigned 
thereto. 

Referring back to Fig. 2, after the path is determined, it is preferably smoothed (38). In 
accordance with a preferred embodiment of the invention, the amount of smoothing is 
dependent on the width of the passage thorough which the path passes. For example, the path 
is not smoothed in very narrow passages, so as to lessen the danger of the smoothed path 
passing though a boimdary. 
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Thereafter, viewing parameters, such as the motion of the viewport and viewport 
parameters are preferably determined (40), so as to completely define the path. 

The above described method can be implemented in many ways. Usually, there is a 
tradeoff between accuracy and computation time. In some cases, there is also a tradeoff with 
the complexity of the implementation. One example of a tradeoff between accuracy and 
computation time is the granularity of the data set used for the path determination. Reducing 
the granularity of the data set, reduces the number of voxels and thus shortens the computation 
time required to apply the method. The granularity of the data may be reduced by increasing 
the voxel size by a fixed ratio and rebinning the data set into the new voxels. Alternatively, 
each portion of the data can be provided with a different granularity. In a preferred 
embodiment of the invention, a user is provided with several choices of granularity. 

It should be appreciated that there are several steps of the method for which the data 
and or computation granularity may be changed, and there is no necessity that the same 
granularity be used for all the steps. For example, in a preferred embodiment of the invention, 
described below, the distance function is evaluated by erosion of the cavity. Granularity can be 
set by selecting a minimum ball size and/or a radius increment, thereby reducing 
computational time, but decreasing the quality (accuracy) of the determined distance. 
Additionally or alternatively, the parameters of ball radius size and increment can be set for a 
skeletonization step, described below. Additionally or alternatively, in a preferred embodiment 
of the invention, not all the voxels are used as vortexes in the graph used for Dijkstra's method, 
for example, by averaging neighboring voxels, or by skeletonization, described below. In each 
of the above described granularity decisions, the granularity can be made dependent on local 
characteristics, such as local passage width. 

Fig. 4 is a flowchart of a method of calculating a distance fimction between each point 
in a cavity and the boundaries of the cavity, in accordance with a preferred embodiment of the 
invention. In a preferred embodiment of the invention, the distance fimction is calculated by 
erosion of a copy of the dataset with balls of increasing radius. First, all the voxels in the 
cavity are assigned a distance of zero. This may also be done by erosion with a ball of radius 
zero. An erosion radius r is set to a minimum erosion radius (48), preferably zero, but possibly 
other small values, such as one or two. Next, the cavity is eroded with balls of the erosion 
radius (50). All the un-eroded voxels in the cavity are assigned a distance of r (52). The 
process is repeated with an incremented radius r (54), if there are any remaining interior 
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voxels. Preferably the increment in the radius is one, however, other increments may be used, 
preferably as a way of modifying the granularity. 

In accordance with a preferred embodiment of the invention, erosion with a ball of 
radius r is approximated by erosion with a plurality of balls whose sum of radii is r. Preferably, 
at least some of the steps in the erosion process are performed by eroding the result of a 
previous step with a small radius ball, rather than by eroding the original cavity with a single 
ball of radius r. Preferably the small radius ball is of radius 1 (or any other granularity) and the 
previous erosion step used is the preceding step. It should be appreciated that a ball of radius 1 
has a diameter D of 3 voxels, since only (D-l)/2 voxels are eroded. In some cases, the use of 
such a small ball will cause artifacts, due to the discrete nature of the voxels. Preferably, 
different types of balls are used for altemating erosion steps. In a preferred embodiment of the 
invention three types of radius 1 balls are used: a complete 3x3x3 CUBE ball; a center voxel 
with six neighbors (CROSS ball); and a 3x3x3 cube with the comers CHOPPED off. The ball 
types are preferably alternated in the following order: {cross, full, chopped, cross, full, cross, 
15 chopped, cross, full, cross, cross, full, cross, cross, fiill, cross, cross} the series is continued as 
repetitions of {fiill, cross, cross}. 

In a preferred embodiment of the invention, the distances between interior voxels and 
the boundaries are calculated using wave propagation from the cavity boundaries. Preferably, a 
graph is built using the voxels and a breadth first search is performed on the graph. Preferably, 
20 a ball of radius one is used to determine neighbors of a vortex. Alternatively or additionally, 
the distances can be calculated using Dijkstra's method. Preferably, approximate real distances 
are calculated, rather than by adding up unit values of distances between voxel centers. 
Preferably, the distance data is represented using a floating point representation. 

In accordance with a preferred embodiment of the invention, the tissue is segmented 
25 into cavity interior voxels through which the path must pass and cavity boundary voxels, 
through which the path may not pass. Alternatively, a segmented data set is provided. In a 
preferred embodiment of the invention, the boxmdary and interior segments are identified 
based on a CT number and/or coimectivity, as is well known in the art. Segmentation using 
thresholding is described, for example, in "Handbook of Pattern Recognition and Image 
30 Processing", edited by T.Y. Young and K.S. Fu, Academic Press, pp. 224-225, the disclosure 
of which is incorporated herein by reference. Alternatively, other methods such as are well 
known in the art, may be used to accomplish segmentation. In a preferred embodiment of the 
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invention, especially preferred where data set 10 is segmented into a plurality of different 
tissue types, a user indicates to the system which tissues are interior and which are exterior. 
Alternatively, the user indicates tissue at the boimdary of the cavity and marks it as exterior 
tissue voxels. It should be appreciated that the interior voxels need not be empty voxels. For 
example, a path can be planned which navigates a bone, with the fat and muscle tissue 
surrounding the bone being considered exterior tissues. 

In a preferred embodiment of the invention, segmentation is performed manually, using 
tools such as thresholding and connectivity. Preferably, the tissue is eroded for the 
connectivity determination, to smooth over small errors. 

In accordance with a preferred embodiment of the invention, a user enters various 
parameters which can be use to restrict the range of possibilities for the automatic path 
generation. In accordance with a preferred embodiment of the invention, at least some of the 
parameters are associated with rigid restrictions. Alternatively or additionally, at least some of 
the parameters are associated with flexible restrictions, which can be traded-off with at least 
some other parameters. This trade-off is preferably achieved by defining a composite path 
grading function including a relative weighting of different restrictions. Flexible restrictions 
are preferably defined using a graded penalty fiinction. Rigid restrictions are preferably 
defined using a penalty function which achieves infinite penalty when the restriction is 
violated. Preferably, the penalty function has a zero penalty if the restriction is not violated. 
Alternatively, the penalty function is graded also for the non-violating situations, so that it may 
be considered to be a flexible restriction in those situations. In a preferred embodiment of the 
invention, the penalty for a voxel is determined by adding up a plurality of penalties, each 
cause by violation and/or partial violation of a restriction. 

In accordance with a preferred embodiment of the invention, the system stores a 
plurality of sets of restrictions/input parameters, which a user can choose between and/or 
modify. Preferably, at least some of these sets are designed to provide optimal paths for certain 
tasks. In one preferred embodiment of the invention, a set is defined which causes the 
generation of a path which meets the restrictions posed by using a physical endoscope. Thus, it 
is easier to simulate what an actual endoscope will view. Preferably, when simulating an 
endoscope, the path is restricted to a maximum bend which is dependent on the particular 
endoscope and the width of the passage against whose walls the endoscope is pressed. 
Preferably, the viewing characteristics of such an endoscope are also simulated by the 



20 



wo 99/42977 




PCT/IL98/00087 



viewport and/or during the image generation. Preferably, these viewing characteristics include 
the lens type of the endoscope. 

In preferred embodiments of the invention, at least some of the following parameters 

may be entered by a user: 

(a) granularity, preferably including parameters for determining local granularity; 

(b) allowed distance of path from the wall; 

(c) penalty function, preferably entered as parameters to one of a set of predefined 
parametric penalty functions and/or distance functions or as a look-up table; 

(d) desired amount and/or type of smoothing, preferably including limitations on 
smoothing responsive to the morphology of the passage, for example, passage width; 

(e) viewing parameters, preferably including, maximum desired twist and other types 
of motion of viewport, field of view, distortion of field of view, shape and aspect ratio of field 
of view, preferably organized as sets corresponding to optical properties of various invasive 
tools; 

(f) parameters for simulation of mechanical properties of invasive tools, preferably 
including a path dependent penalty function; and 

(g) rendering and display parameters, such as, colors, false color scheme, shading, 
illumination and path thereof, reflections and relative transparency of tissues. 

In accordance with a preferred embodiment of the invention, a user may supply 
parameters which define and/or determine what is meant by the quality of the generated view. 
Such parameters may be determined, inter alia, by perceptual considerations, task-specific 
considerations and/or comfort of viewing considerations. It should be appreciated that the 
quaUty of view will generally be affected also by the above listed parameters. In a preferred 
embodiment of the invention, these parameters include at least one of: 

(a) a maximum allowed speed; 

(b) maximimi allowed twist rate of the viewport; 

(c) maximum allowed change in various viewing parameters; and 

(d) portions of the data set which the user want to view at such suitable parameters, 
possible the entire iimer surface of the cavity. 

In a preferred embodiment of the invention, the path and angular orientation of the 
viewport origin and/or of the viewport are automatically generated so that the portions which 
are desired to be viewed are within comfortable viewing conditions. 
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In a preferred embodiment of the invention, the generated path is smoothed, to reduce 
jerkiness in the view. Preferably, at least some of the above desired viewing quaHty parameters 
are met as a result of this smoothing. Preferably, after the smoothing, the path is analyzed to 
determine if it passes too close to boundary voxels and/or violates other restrictions. 
Preferably, the path is not smoothed at portions of the path which are very close to cavity 
boundaries and/or in narrow passages. Alternatively or additionally, different types of 
smoothing are applied responsive to the path characteristics and/or cavity morphology and/or 
passage width. 

In accordance with a preferred embodiment of the invention, the smoothing is a linear 
combination between a point and its neighbors. Preferably one neighbor on each side is used, 
and the relative weighting is {0.3, 0.4, 0.3}. In accordance with a preferred embodiment of the 
invention, the entire path is smoothed a number of times, preferably seven times. Preferably, 
portions of the path which are closer than a predetermined distance to the boundary are not 
smoothed. Altematively or additionally, the number of times a point is smoothed and/or the 
weights used and/or the type of smoothing is dependent on the distance from the boundary. 
Preferably, smoothing is not performed at the goal points. Altematively, smoothing is 
performed at least at the starting and ending points. 

In a preferred embodiment of the invention, at least one of the viewing parameters is 
also smoothed, so that changes in its values are smoother. In one preferred embodiment of the 
invention, a desired angular resolution is required for the viewing of various portions of data 
set 10. Preferably, when such an angular field of view requires a change in the field of view, 
these changes in field of view are smoothed. 

In a preferred embodiment of the invention, the view aiming point is chosen to be a 
point along the path, forward of the view origin point. The location of the view aiming point is 
preferably determined responsive to the local bending at the view origin point and/or to the 
distance to the boundary, i.e. the distance between the two points is inversely dependent on the 
local bend and proportional to the distance to the boundary. As a result, in tight portions of the 
path, the view aiming point is relatively closer to the view origin point and so a smoother 
viewing angle is obtained. Altematively or additionally, the view aiming point location may be 
dependent on the path and/or boundary characteristics at the projected view aiming point 
and/or a portion of the future path. 



22 



wo 99/42977 




PCT/IL98/00087 



In most, if not all, medical images, the existence of noise is a very important 
consideration. Usually, acquiring images with a lower noise level increases the exposure of a 
patient to ionizing and/or otherwise dangerous radiation. In addition, many medical images 
have various types of artifacts. One problem caused by noise is that the boundary of the cavity 
5 may have holes in it, where a noise value has replaced or mutated the original, exterior voxel 
value. In a preferred embodiment of the invention, such holes are ignored, since in order for 
the path to pass through such a hole, it must pass very close to boundary voxels, which is 
extremely "imdesirable", as a function of the distance function. 

One problematic situation is when two cavities pass close together, such as is typical of 
10 the bowel. The addition of noise and/or partial volume artifacts may cause the boundary 
between the two cavities to disappear at certain locations. However, in accordance with a 
preferred embodiment of the invention, small missing portions of the boundaries are ignored 
since in order to pass through them, a penalty cost must be paid. Cavity enlargements and/or 
distortions caused by partial volume effects are generally not an issue in some preferred 
15 embodiments of the invention, since the path does not usually pass near the boundaries in 
these embodiments and/or is not affected by small variations in the boundary texture. 

Another problem possibly caused by noise, is the creation of exterior tissue voxels in 
the middle of the cavity space. In a preferred embodiment of the invention, small groups of 
exterior tissue voxels, which are spaced from other exterior tissue voxels, are ignored during 
20 various steps of the path planning, such as during distance calculation and/or by allowing the 
path to pass through the voxels. The number, extent and separation of these voxels is 
preferably a parameter of the algorithm. Additionally or alternatively, preferably depending on 
the grouping of the suspected noise voxels, these voxels are removed during segmentation. 

In accordance with a preferred embodiment of the invention, not all the voxels in the 
25 cavity are considered during the path determination. Rather, only a subset of the voxels are 
considered. Preferably, this subset is generated by creating a skeleton of the cavity. 

Fig. 5A is a schematic illustration of a skeletonized cavity 60, in accordance with a 
preferred embodiment of the invention. Skeletonization is described for example in "An 
introduction to Morphological Image Processing" by E.R. Dougherty, SPIE Press, 1992, pp. 
30 42-48, the disclosure of which is incorporated herein by reference. The skeleton of a body is 
defined as a set of points which are the centers of maximal balls which are bound by the body 
and which are not included in any other such bound ball (overlap is allowed). Such a skeleton 
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generally retains the morphological features of the body. In Fig. 5A, a two-dimensional 
skeletonization including only a small subset 64 of the maximal balls, is shown. A skeleton 62 
is a set of points which generally follows the contours of the body. In some preferred 
embodiments of the invention, only voxels which overlap the skeleton or within a certain 
5 radius from the skeleton are considered for the path. This radius may, in some preferred 
embodiments of the invention, be dependent on local morphology of the cavity. Once the path 
is determined, it will usually need to be interpolated and/or resampled to provide view origin 
points, which may, in some embodiments of the invention, lay between skeleton voxels. 
Alternatively or additionally, the determined path is smoothed, so that it may include voxels 
10 other than from the skeleton. 

In accordance with a preferred embodiment of the invention, a graph is generated from 
voxels of the skeleton. In a preferred embodiment of the invention, the arcs of the graph are 
generated by defining neighbors for each voxel of the skeleton. Preferably all the voxels of the 
skeleton which are within a predetermined distance of a particular voxel, are connected to the 
15 voxel. Alternatively or additionally, the distance is determined responsive to the number of 
nearby voxels. Alternatively or additionally, the distance is determined responsive to the 
morphology of the cavity. 

In a preferred embodiment of the invention, portions of the graph are constructed only 
when actually needed, using lazy evaluation techniques. 
20 Fig. 5B is a flowchart of a method of skeletonizing, in accordance with a preferred 

embodiment of the invention. This method is based on maximal balls with a radius r being 
equivalent to opening with a ball of radius 1, a data set which was previously eroded with a 
ball of radius r. Opening is a composite process comprising eroding and then dilating (adding a 
layer). Thus, in accordance with a preferred embodiment of the invention, a skeleton is 
25 generated at the same time as the distance function, utilizing the partially eroded data set as an 
input. In the figure, the starting skeletonization radius is set (70) to zero. As with erosion, 
values other than zero may be selected and they affect the precision of the skeleton and/or may 
smooth the cavity morphology and/or reduce the effects of noise. Tissue eroded by a ball of 
radius r (72) is opened with a ball of radius 1 (74). Voxels which are removed by the opening 
30 operation, correspond to centers of maximal balls of radius r and are preferably accumulated 
and added to the skeleton (76). It should be noted that opening comprises eroding and then 
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dilating. The above described process of erosion also generates a data set which includes the 
effect of eroding with a ball of radius 1, the result of an erosion with a ball of radius r. 

In some preferred embodiments of the invention, the data set is represented using 
polygons, which described surfaces of the boundary, alternatively to or in addition to using 
voxels. Preferably, the inside of the cavity is determined using a 3D paint function and/or may 
be known from the segmentation and/or may be determined when the polygon data is 
generated from the image data. Preferably, this determination is made for points on a grid. 
Distance calculation may be performed using the same grid. For each point on the grid, which 
is interior to the cavity, the distance to the nearest polygon is detemiined. Preferably, and 
especially where the polygons have a bounded size, locality functions are used to limited the 
number of polygons which are tested. In a preferred embodiment of the invention, a penalty 
function may be defined in which any distance to the boundary above a certain distance has the 
same penalty value. Thus, if there are no polygons within that distance, there is no need to 
look further and calculate the distance. Thereafter, the path finding method may be applied to 
the grid points using the determined distance function. Preferably, the calculated distance is 
used to determine a skeleton of the grid. 

In a preferred embodiment of the invention, the viewport is directed to a view aiming 
point along the path. Altematively or additionally, the view aiming point moves along a 
different trajectory. In a preferred embodiment of the invention, the view aiming point spirals 
around path 16, so that the viewing direction is substantially perpendicular to the path. This 
type of path is useful for a careful survey of the inside of a cavity, for example, for colonscopy. 
Ahematively to a substantial perpendicular angle, any other angle may be used, especially to 
assure an overlap between consecutive images and/or portions of the spiral. Preferably, the 
viewport is also slightly twisted so that the axes of all the individually generated frames may 
be made as parallel as possible. 

In accordance with a preferred embodiment of the invention, portions of data set 10, 
which are not displayed or are not displayed within desired parameters, are indicated to the 
user. In one preferred embodiment of the invention, they are indicated separately from the 
endoscope-eye view, preferably on a plan-view or on a three-dimensional perspective view. 
Altematively or additionally, these indications are overlaid as symbols on the real-time virtual 
endoscope view. 
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In accordance with a preferred embodiment of the invention, the view is rendered using 
a raycasting method, for example as described in U.S. provisional application titled 
"Raycasting System and Method", filed on February 23, 1998, by applicants S. Akerman and 
G. Miller, the disclosure of which is incorporated herein by reference. Preferably, the distance 
from the boundary which is determined for each point along the path, is used as a lower limit 
for the ray casting algorithm, since there can be no exterior voxels closer than the determined 
distance. 

Although the above methods are generally described as including the plaiuiing of all 
the aspects of the path, in a preferred embodiment of the invention, the above described 
methods are used for only some of the aspects. Alternatively or additionally, the order of steps 
may be changed and/or steps split into sub-steps and/or combined. In a preferred embodiment 
of the invention, lazy evaluation techniques are utilized, to delay heavy computations and/or 
reduce memory requirements as much as possible. Such computations include, evaluating a 
penalty function and/or constructing a graph. 

In a preferred embodiment of the invention, a user performs real-time control of 
various viewing parameters while viewing a path generated in accordance with a preferred 
embodiment of the invention. Such parameters may include illumination parameters, such as 
position, movement and decay as a fimction of distance, speed, direction of gaze, angle of 
gaze, field of view size and aspect ratio. 

In accordance with some preferred embodiments of the invention, some of the methods 
described herein are appUed in an iterative manner. In one preferred embodiment of the 
invention, a user enters limitations, the system generates a path which attempts to meet these 
limitations and then the user possibly changes these limitation, based on the quality of the 
generated path and/or the generated view. Preferably, at least some of the computations, such 
as distance computations, are performed only once and not repeated each iteration. 
Additionally, preferably not all the limitations need to be entered each iteration. One example 
of user entered limitations is a set of points through which it is desired that the path pass. 

Additionally or alternatively, the above described methods may be applied as a post 
processing step to a path generated by other means and/or entered by a user, especially for 
smoothing such a path and/or for calculation of viewing parameters. In one preferred 
embodiment of the invention, only optimal viewing angles and velocities are determined for a 
fixed path. In a preferred embodiment of the invention, the methods are used to select a path 
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from a (preferably small) set of paths. Additionally or alternatively, the above described 
methods may be applied to evaluate an existing path, especially after a user modified it or if it 
was smoothed, to determine if any user selected restrictions are violated and/or to assign a 
grade of viewing quality to the path. Preferably, the methods are used to grade possible paths 
to aid a user in selecting one of these paths. 

In accordance with a preferred embodiment of the invention, an existing path may be 
optimized by generating a graph which includes only voxels included in and within a certain 
distance from the path and applying the path finding methods on that graph. Preferably, the 
width of the graph is dependent on the local and/or typical width of the cavity. 

It should be appreciated that the methods described herein may also be used to add a 
goal point in the middle of an existing path and/or to connect two paths smoothly. In some 
cases, only the smoothing portions of the algorithm may be applied. Alternatively, a graph 
may be generated which includes a region surrounding the point to be added to the graph 
and/or at which the graph are connected and a path optimizing method may be applied to that 
(local) graph. 

In accordance with a preferred embodiment of the invention, goal points entered by a 
user are moved slightly so that sharp bends in the path are reduced. Alternatively or 
additionally, goal points are moved so that they are at more desirable location. Such motion is 
preferably limited to a small distance and/or a small number of dimensions. Preferably, these 
points are moved perpendicular to the path and/or the tissue boundary, depending on what 
stage of processing these points are moved. 

In accordance with a preferred embodiment of the invention, more than one tissue may 
be included in the interior voxels and/or the exterior voxels. Additionally or alternatively, at 
least one tissue-type may be defined to be semi-transparent. Additionally or alternatively the 
type of tissue at a voxel may affect the penalty of passing through that voxel. Alternatively or 
additionally, it is desirable that the path passes through a minimum number of tissue 
boundaries. This is preferably achieved by assigning passing between tissue type a high 
penalty (but preferably not an infinite penalty). Preferably, the penalty is a function of the 
distance from the boundary between the tissues. 

In a preferred embodiment of the invention, tissue types are stored by using a bit- 
volume for each tissue type with a value of "1" for all the voxels which are of the tissue type. 
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Alternatively, each voxel may be assigned a value which indicates a tissue type. As can be 
appreciated, a single voxel may, in some cases, be assigned more than one tissue type. 

In a preferred embodiment of the invention, the penalty function depends on the 
distance from different tissue types. For example, it may be less desirable to be within 5 voxels 
of tissue type A than within 5 voxels of tissue type B. Preferably, a different distance is 
calculated for each tissue type. Alternatively only the distance to the closest tissue is 
calculated. 

In a preferred embodiment of the invention, a given tissue may be less desirable for 
travel, but travel therethrough may be allowed. Preferably, the penalty function is not infinite 
for that tissue, as it preferably is for exterior voxels. It should be appreciated that an exterior 
type tissue may also be transparent and/or semi-transparent. 

In a preferred embodiment of the invention, different tissue types are indicated using 
transparent hued voxels and/or using volume textures. 

In a preferred embodiment of the invention, two or more data sets are registered and 
displayed together. Two such data sets may be acquired at different times, using different 
modalities and/or may be of the same tissue but at different phase of cyclic motion thereof. 
Preferably, the path is constrained to pass within a cavity which is defined by the intersection 
of all the cavities. 

It should be appreciated that in some preferred embodiments of the invention, a 
trajectory may not be continuous. For example, a trajectory of the view origin may consist of 
segments. In another example, the view aiming point may have a very fragmented trajectory. 
However, since the generated view is often viewed in a serial manner, the word trajectory is 
used to described the progression of the view origin and/or the aiming point from the first 
frame of the view to the last frame. In addition, it should be noted that even a continuos 
trajectory comprises a finite number of discrete points at which a view is generated. 

It should be appreciated that the above described methods of automatic path 
determination, as described hereinabove contain many features, not all of which need be 
practiced in all embodiments of the invention. Rather, various embodiments of the invention 
will utilize only some of the above described techniques, features or methods and or 
combinations thereof. In addition, although the above description is focused on methods, 
apparatus for performing these methods is also considered to be within the scope of the 
invention. Additionally or altematively, other methods of path finding may be used. In 
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accordance with a preferred embodiment of the invention, methods known for penalty 
optimization are applied to determine an optimal path between the goal points in view of 
penalties assigned as described hereinabove. 

It will be appreciated by a person skilled in the art that the present invention is not 
limited by what has thus far been described. Rather, the present invention is limited only by 
the claims which follow. 
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CLAIMS 

1 . A method of path planning, comprising: 

providing a medical imaging dataset representing a cavity and a boundary; 
providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
responsive to a penalty associated with passing through various points in the cavity. 

2. A method according to claim 1, wherein said penalty function is responsive to a 
morphology of the cavity. 

3. A method according to claim 2, wherein said morphology comprises a width. 

4. A method according to claim 2 or claim 3, wherein said morphology is a local 
morphology. 

5. A method according to any of claims 1-4, wherein said penalty function is responsive 
to the path. 

6. A method according to claim 5, wherein said penalty function is responsive to an 
amount of local bending of the path. 

7. A method according to any of claims 1-6, wherein automatically determining a path 
comprises automatically determining a trajectory of an origin of a viewport. 

8. A method according to any of claims 1 -7, wherein providing a plurality of points 
comprises providing a trajectory. 

9. A method according to any of claims 1-8, wherein automatically determining a path 
comprises automatically determining a trajectory of an aiming point. 
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10. A method according to any of claims 1-9, wherein automatically determining a path 
comprises automatically deteraiining an angular orientation of a line of sight, relative to a path 
traveled by a viewport origin. 

11. A method according to any of claims 1 -9, wherein automatically determining a path 
comprises automatically deteraiining an angular orientation of a line of sight, relative to a path 
traveled by a viewport origin, responsive to a local width of the cavity. 

12. A method according to any of claims 1-9 or 11, wherein automatically determining a 
path comprises automatically determining an angular orientation of a line of sight, relative to a 
path traveled by a viewport origin, responsive to a local bend of the path. 

13. A method according to any of claims 1-10, wherein automatically determining a path 
comprises automatically determining at least one viewing parameter along a trajectory of a 
view origin point. 

14. A method according to any of claims 1-13, wherein said penalty depends on a viewing 
quality possible from a point. 

15. A method according to claim 14, wherein said viewing quality depends on human 
perceptual abilities. 

16. A method according to claim 14 or claim 15, wherein said viewing quality depends on 
a specific task to be performed with said path. 

17. A method according to any claims 1-16, comprising smoothing the path. 

18. A method according to claim 17, wherein said smoothing is dependent on a local width 
of the cavity, at the smoothed portion of the path. 
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19. A method according to any of claims 1-18, comprising automatically repeating at least 
said automatically determining a path between said starting and ending pomts. 

20. A method according to any of claims 1-19, comprising providing at least one user- 
provided limitation on said path determination. 

21 . A method according to claim 19, wherein automatically repeating comprises 
automatically repeating automatically determining a path, responsive to at least one user- 
provided limitation. 

22. A method according to claim 20 or claim 2 1 , wherein said at least one limitation 
comprises a rigid limitation. 

23. A method according to any of claims 20-22, wherein said at least one limitation 
comprises a flexible limitation. 

24. A method according to any of claims 20-23, comprising indicating to a user which 
limitations are not met. 

25. A method according to any of claims 1-24, comprising selecting a data granularity 
level for said path determination. 

26. A method according to any of claims 1-25, wherein automatically determining a path 
comprises evaluating a penalty function for the points. 

27. A method according to claim 26, wherein said penalty function is dependent on the 
distance of the point from a boundary of the cavity. 

28. A method according to claim 27, wherein said penalty function is lower for points 
which are further from the boxmdary. 
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29. A method according to claim 28. wherein said penalty function has a substantial rate of 
increase when approaching said boimdary. 

30. A method according to claim 28 or claim 29, wherein said penalty function has a low 
rate of change away from said boundary. 

31. A method according to any of claims 27-30, comprising determining said distance by 
erosion of the dataset. 

32. A method according to any of claims 27-30, comprising determining said distance by 
wave propagation from the boimdaries of said cavity. 

33. A method according to any of claims 1-32, wherein said determining a path comprises 
determining a relatively short path. 

34. A method according to claim 33, wherein a relatively short path comprises a shortest 
path which takes into consideration the penalty value associated with the various locations. 

35. A method according to claim 33 or claim 34, wherein automatically determining a path 
comprises generating a graph representing at least a portion of the cavity. 

36. A method according to claim 35, wherein said path is determined by applying a path 
finding method to the graph and wherein said portions of said graph are generated only when 
needed by said method. 

37. A method according to claim 35 or claim 36, wherein automatically determining a path 
comprises determining a path using Dijkstra's shortest path finding method on said graph. 

38. A method according to any of claims 35- 37, wherein said graph includes only a subset 
of voxels in said cavity. 
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39. A method according to claim 38, wherein said graph comprises substantially only a 
skeleton of said cavity. 

40. A method according to claim 39, wherein said skeleton is found utilizing data from 

5 erosion of the cavity, which erosion is utilized to determine a distance of interior points from 
said boundary. 

41 . A method according to any of claims 1 -40, wherein said dataset is represented by 
voxels. 

10 

42. A method according to any of claims 1-41, wherein said boundary is represented by 
polygons. 

43. A method according to any of claims 1-42, wherein said dataset comprises a CT 
15 dataset. 

44. A method according to any of claims 1-42, wherein said dataset comprises an MRI 
dataset. 

20 45 . A method according to any of claims 1 -42, wherein said dataset comprises a NM 
dataset. 

46. A method according to any of claim 1-45, wherein said boundary has small holes 
therein and wherein said path does not pass through holes narrower than a predetermined 

25 width. 

47. A method according to claim 46, wherein said predetermined width is dependent on a 
morphology of the cavity. 

30 48. A method of path planning, comprising: 

providing a medical dataset representmg a cavity having a plurality of bends and a 

boundary; 
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providing a plurality of points in said dataset, including at least a starting point and an 
ending point; 

automatically determining a path between the starting point and the ending point, 
wherein said path does not remain substantially in a medial axis of the cavity and does not 
approach closer than a predetemiined distance to said boundary, in at least two of said bends. 

49. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does not approach closer than one voxel to said boundary. 

50. A method according to claim 48, wherein said dataset is represented using voxels and 
wherein said path does not approach closer than three voxels to said boundary. 

5 1. A method according to claim 48, wherein said dataset is represented usmg voxels and 
wherein said path does not approach closer than one tenth the local width of said cavity, to said 
boimdary. 

52. A method accordmg to claim 48, wherein said dataset is represented using voxels and 
wherein said path does pass through holes in said boundary which are narrower than a 
predetermined width. 

53 . A method of skeletonizing a dataset including a cavity and a boimdary thereof, 
comprising: 

eroding said cavity, using balls of increasing radius R; 

determining a distance of points interior to the cavity, from the boundary, utilizing said 
erosion; 

opening said eroded cavity, for each radius R, using a ball of radius 1; and 
accumulating the points which are removed from said eroded cavity by said opening, to 
form a skeleton. 

54. A method according to claim 53, wherein erosion by a ball R comprises erodmg the 
result of eroding with a ball of radius R- 1 , with a ball of radius 1 . 
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55. A method of path planning, comprismg: 

providing a dataset rqjresenting a cavity and a boundary; 

providing a plurality of points in said dataset, including at least a starting point and an 
ending point; and 

automatically determining a path between the starting point and the ending point, 
responsive to a penalty associated with passing through various points in the cavity. 

56. A method according to claim 55, wherein said penalty function is responsive to a width 
of the cavity. 

57. A method according to claim 55 or claim 56, wherein said penalty function is 
responsive to an amount of local bending of the path. 

58. A method according to any of claims 55-57, wherein automatically determining a path 
comprises evaluating a penalty function for the points. 

59. A method according to claim 58, wherein said penalty function is dependent on the 
distance of the point from a boundary of the cavity. 

60. A method according to claim 59, wherein said penalty function is lower for points 
which are further from the boimdary. 

61 . A method according to any of claims 55-60, wherein said determining a path comprises 
determining a relatively short path. 

62. A method according to claim 6 1 , wherein a relatively short path comprises a shortest 
path which takes into consideration the penalty value associated with the various points. 

63. A method according to claim 61 or claim 62, wherein automatically determining a path 
comprises generating a graph representing at least a portion of the cavity and wherein said path 
is deteraiined by applying a path finding method to the graph and wherein said portions of said 
graph are generated only when needed by said method. 
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